
United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 
Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
www.uspto.gov 



APPLICATION NO. 



FILING DATE 



FIRST NAMED INVENTOR 



| ATTORNEY DOCKET NO. | CONFIRMATION NO. ' 



10/814,844 



03/30/2004 



Jonathan J. Hull 



20412-08497 



6502 



758 7590 10/17/2006 

FENWICK & WEST LLP 
SILICON VALLEY CENTER 
801 CALIFORNIA STREET 
MOUNTAIN VIEW, CA 94041 



EXAMINER 



] 



STEVENS, ROBERT 



ART UNIT 



PAPER NUMBER 



2162 

DATE MAILED: 10/17/2006 



Please find below and/or attached an Office communication concerning this application or proceeding. 



PTO-90C (Rev. 10/03) 



kJTTICG Mcaon ouuifnary 


Application No. 

10/814,844 


Applicant(s) 
HULL ET AL 


Examiner 

Robert Stevens 


Art Unit 

2162 





-- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)S Responsive to communication(s) filed on 30 March 2004 . 
2a)D This action is FINAL. 2b)K This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quay/e, 1935 CD. 11, 453 O.G. 21 3. 

Disposition of Claims 

4) S Claim(s) 1-45 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) [X] Claim(s) 7-45 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)Q The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
11 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1) Notice of References Cited (PTO-892) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) 03 Information Disclosure Statement(s) (PTO/SB/08) 

Paper No(s)/Mail Date 5 IDS's . 



4) O Interview Summary (PTO-413) 

Paper No(s)/Mail Date. . 

5) [H Notice of Informal Patent Application 

6) □ Other: . 



U.S. Patent and Trademark Office 
PTOL-326 (Rev. 08-06) 



Office Action Summary 



Part of Paper No./Mail Date 2006101 1 



Application/Control Number: 10/814,844 Page 2 

Art Unit: 2162 

DETAILED ACTION 
Information Disclosure Statement 

1 . The information disclosure statement filed 1 2/27/2004 fails to comply with the 
provisions of 37 CFR 1 .97, 1 .98 and MPEP § 609 because several of the non-patent 
literature articles are in Japanese (and no English translation of said articles has been 
provided). These articles are listed as citations C1, C10-C11, and C13-C18. They have 
been placed in the application file, but the information referred to therein has not been 
considered as to the merits. Applicant is advised that the date of any re-submission of 
any item of information contained in this information disclosure statement or the 
submission of any missing element(s) will be the date of submission for purposes of 
determining compliance with the requirements based on the time of filing the statement, 
including all certification requirements for statements under 37 CFR 1.97(e). See 
MPEP § 609.05(a). 

Claim Rejections - 35 USC § 101 

2. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

3. Claims 1 - 41 are rejected under 35 U.S.C. 101 because the claimed invention 
is directed to non-statutory subject matter. 
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To be statutory, a claimed computer-related process must either: (A) result in a 
physical transformation outside the computer for which a practical application is either 
disclosed in the specification or would have been known to a skilled artisan, or (B) be 
limited to a practical application with useful, concrete and tangible result. 

A practical application can be either physical transformation or a useful, concrete 
and tangible result 

The claims lack the necessary physical articles or objects to constitute a machine 
or a manufacture within the meaning of 35 USC 101 . They are clearly not a series of 
steps or acts to be a process nor are they a combination of chemical compounds to be 
a composition of matter. As such, they fail to fall within a statutory category. They are, at 
best, functional descriptive material perse. 

The computer readable media as recited in the claims 21-40 can be a storage 
medium as well as a "streaming media signal" or "a cable signal" as described in 
applicant's disclosure. These particular sections in the disclosure refer to 
"communication media." These claims are not patent eligible because claims lack the 
necessary physical articles or objects to constitute a machine or a manufacture within 
the meaning of 35 USC 101 . They are clearly not a series of steps or acts to be a 
process nor are they a combination of chemical compounds to be a composition of 
matter. As such, they fail to fall within a statutory category. They are, at best, functional 
descriptive material per se. 
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Claim Rejections - 35 USC §112 

4. The following is a quotation of the second paragraph of 35 U.S.C. 1 1 2: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

5. Claims 1 - 45 are rejected under 35 U.S.C. 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter which 
applicant regards as the invention. 

Independent claims 1 and 25 each recite the limitation "[the] feature extraction 
information" in lines 6 and 5, respectively. There is insufficient antecedent basis for this 
limitation in the claim. It appears that the recited "features" in line 3 (of each claim) 
might be the intended antecedent basis, but the it is noted that "feature" and "feature 
information" do not have the same meaning. 

Further regarding independent claims 1 and 25: The preamble of each claim 
indicates the generation of a "representation of time-based media", yet there is no 
positively recited generation step in either of these claims. As such, these claims 
appear to omit an essential step or element, as appropriate. Therefore, the scope of 
each of these claims is unclear. The Office notes that the recited formatting module of 
claim 1 appears to reflect an intended use of a generated media representation. 
Additionally, claim 25 formats "the representation", but that "representation" isn't actually 
created until claim 26. It is unclear how formatting can take place before the creation of 
the "representation". 
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Further regarding claims 27-29: These claims each recite the limitation "the 
media data" in line 2 of each claim. There is insufficient antecedent basis for this 
limitation in the claim. 

Claims 2-24 and 26-45 are dependent upon claims 1 and 25, respectively, and 
therefore are likewise rejected. 



Claim Rejections - 35 USC § 103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 



7. Claims 1-6, 11-31 and 35-43 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Sekiguchi et al. (US Patent No. 6,61 1,628, filed Nov. 17, 2000 and 
issued Aug. 26, 2003, hereafter referred to as "Sekiguchi") in view of Kanevsky et al. 
(US Patent No. 6,687,383, filed Nov. 9, 1999 and issued Feb. 3, 2004, hereafter 
referred to as "Kanevsky"). 
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Regarding independent claim 1: Sekiguchi teaches A system for generating 
a representation of time-based media, (See Sekiguchi Abstract.) the system 
comprising: a feature extraction module for extracting features from media 
content; (See Sekiguchi Abstract, discussing feature extraction.) and a formatting 
module for formatting a media representation generated by the system, the 
formatting module being communicatively coupled to the feature extraction 
module to apply feature extraction information to the representation, (See 
Sekiguchi column 2 lines 55-60, discussing the generation of a feature stream.) 

However, Sekiguchi does not explicitly teach the limitations as claimed. 
Kanevsky, though, discloses wherein the formatting module formats the 
representation according to a representation specification. (See Kanevsky Figure 3 
#35 "constraints" in the context of column 4 lines 2-1 1 discussing representation 
constraints.) 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to apply the teachings of kanevsky for the benefit of Sekiguchi, because to do 
so provided a mechanism for hardcopy printing of multimedia data, as taught by 
Kanevsky in the Abstract. These references were all .applicable to the same field of 
endeavor, i.e., multimedia encoding. 
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Regarding claim 2: Sekiguchi discloses wherein the feature extraction 
module further comprises content recognition software for recognizing features 
in media content (See Sekiguchi column 3 lines 17-23, discussing object recognition.) 



Regarding claims 3-4: Sekiguchi does not explicitly teach these limitations as 
claimed. Kanevsky, though, discloses output device driver interface and output device 
console. (See Kanevsky Figure 3 #80 print means in context of column 6 lines 5-6, 
discuss a printer output device, it being inherent/implicit that a device driver was 
necessary for the printer to work as intended.) 

Regarding claim 5: Sekiguchi discloses wherein the media representation is 
generated in digital format (See Sekiguchi column 4 lines 34-49, discussing 
generations and storage of a feature stream.) 

Regarding claim 6: Sekiguchi does not explicitly teach these limitations as 
claimed. Kanevsky, though, discloses wherein the media representation is 
generated in paper format (See Kanevsky Figure 3 #80 in the context of column 4 
lines 20-22, disclosing printing out a "hardcopy".) 
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Regarding claims 11-12: Sekiguchi discloses wherein the media 
representation includes a graphical representation of media/audio content along 
a timeline. (See Sekiguchi Figure 9 in the context of column 9 lines 43-46 teaching 
video content displayed along a timeline, it having been an obvious variant to one 
skilled in the art at the time of the invention as to what time-based data one displayed.) 

Regarding claims 13-16: Sekiguchi discloses the use of timeline markers 
corresponding to media/audio content and having associated text/timestamp information 
(See Sekiguchi Figure 9 in the context of column 9 lines 43-46 teaching video content 
displayed along a timeline, it having been an obvious variant to one skilled in the art at 
the time of the invention as to what time-based data one displayed. Also see Sekiguchi 
column 13 lines 3-20, discussing the use of segment identifiers.) 

Regarding claim 17: Sekiguchi discloses wherein the media representation 
includes a header describing the media content (See Sekiguchi column 1 1 lines 27- 
30, discussing the use of header information.) 

Regarding claim 18: Sekiguchi does not explicitly teach this limitation as 
claimed. Kanevsky, though, discloses wherein the media representation is 
generated according to format specifications included in a data structure. (See 
Kanevsky Figure 3 #35 "constraints" in the context of column 4 lines 2-1 1 discussing 
representation constraints.) 
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Regarding claims 19-20: Sekiguchi does not explicitly teach this limitation as 
claimed. Kanevsky, though, discloses the use of fields for specifying format and 
content. (See Kanevsky column 7 lines 45-52, discussing the use of tags and URLs as 
content indicators and XSL for formatting purposes.) 

Regarding claim 21: Sekiguchi discloses the use of timeline markers 
corresponding to media/audio content and having associated text/timestamp information 
(See Sekiguchi Figure 9 in the context of column 9 lines 43-46 teaching video content 
displayed along a timeline, it having been an obvious variant to one skilled in the art at 
the time of the invention as to what time-based data one displayed. Also see Sekiguchi 
column 13 lines 3-20, discussing the use of segment identifiers.) 

Regarding claim 22: Sekiguchi discloses wherein the format specifications 
included in the data structure comprise a number of user-definable fields 
specifying the feature extraction applied to the media content {See Sekiguchi 
column 6 line 65 - column 7 line 6, discussing user interaction in the generation of a 
feature stream.) 

Claims 23 and 24 are substantially similar to claims 3 and 6, respectively, and 
therefore likewise rejected. 



Application/Control Number: 10/814,844 
Art Unit: 2162 



Page 10 



Independent claim 25 is substantially directed to a method implemented by the 
system elements of claim 1 . As such, this claim is substantially similar to claim 1 , and 
therefore likewise rejected. 

Regarding claim 26: Sekiguchi discloses generating a representation of 
media content (See Sekiguchi column 2 lines 55-60, discussing the generation of a 
feature stream, and column 6 line 65 - column 7 line 6, discussing user interaction in 
the generation of a feature stream.) 

Regarding claim 27: Sekiguchi discloses wherein extracting features of 
media content further comprises performing keyword searching on the media 
data. (See Sekiguchi column 6 lines 14-25, teaching keyword searching.) 

Regarding claim 28: Sekiguchi does not explicitly teach this limitation as 
claimed. Kanevsky, though, discloses speaker recognition. (See Kanevsky column 7 
lines 53-62, discussing speaker verification/identification.) 

Regarding claim 29: Sekiguchi discloses wherein extracting features of 
media content further comprises performing event detection on the media data. 

(See Sekiguchi column 3 lines 9-12, teaching the use of "movement information".) 
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Claims 30 and 31 are substantially similar to claims 1 1 and 12, respectively, and 
therefore likewise rejected. 

Regarding claims 35-38: Sekiguchi discloses the use of timeline markers 
corresponding to media/audio content and having associated text/timestamp information 
(See Sekiguchi Figure 9 in the context of column 9 lines 43-46 teaching video content 
displayed along a timeline, it having been an obvious variant to one skilled in the art at 
the time of the invention as to what time-based data one displayed. Also see Sekiguchi 
column 13 lines 3-20, discussing the use of segment identifiers.) 

Claims 39, 40 and 41 are substantially similar to claims 17, 5 and 6, 
respectively, and therefore likewise rejected. 

Regarding claim 42: Sekiguchi does not explicitly teach this limitation as 
claimed. Kanevsky, though, discloses wherein formatting the representation 
according to a representation specification further comprises defining the format 
of a media representation using a data structure with format specifications. (See 
Kanevsky Figure 3 #35 "constraints", in the context of column 4 lines 2-1 1 discussing 
representation constraints.) 
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Regarding claim 43: Sekiguchi does not explicitly teach this limitation as 
claimed. Kanevsky, though, discloses inputting audio content and a representation 
specification into the system. (See Kanevsky Figure 3 #25 "audio" input and #35 
"constraints" input, in the context of column 4 lines 2-1 1 discussing representation 
constraints.) 

8. Claims 7-10, 32-34 and 44-45 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Sekiguchi et aL (US Patent No. 6,611,628, filed Nov. 17, 2000 and 
issued Aug. 26, 2003, hereafter referred to as "Sekiguchi") in view of Kanevsky et al. 
(US Patent No. 6,687,383, filed Nov. 9, 1999 and issued Feb. 3, 2004, hereafter 
referred to as "Kanevsky") and further in view of J. Graham et al. ("Video Paper: A 
Paper-Based Interface for Skimming and Watching Video", ICCE '02 . Jun. 18-20, 2002, 
pp. 214-215, hereafter referred to as "Graham"). 

Regarding claims 7-10, 32-34 and 44-45: Sekiguchi does not explicitly teach 
these the use of bar codes as user selectable identifiers. Graham, though, discloses 
the use of barcodes on media representation (See Graham page 215 Figure 1, showing 
barcodes on a multimedia Video Paper document, and the first paragraph on page 215, 
discussing the reading/invoking of a bar code from a Video Paper document to launch a 
video on a TV or PDA. It was implicit that if the bar code existed on the Video Paper 
document of Figure 1 , that the bar code had been "generated". Further, the last 



Application/Control Number: 10/814,844 Page 13 

Art Unit: 2162 

paragraph on page 214 discusses associating time stamp information with the Video 
Paper system.) 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to apply the teachings of Graham for the benefit of Sekiguchi in view of 
Kanevsky, because to do so allowed a user to read a paper document and view only 
those parts of the video that are relevant to their needs, as taught by Graham in the 
Abstract. These references were all applicable to the same field of endeavor, i.e., 
multimedia encoding. 
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Conclusion 

9. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 
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